A machine learning approach for predicting computational intensity and domain decomposition in parallel geoprocessing     

Peng Yue  Fan Gao  Boyi Shangguan  Zheren Yan 《International journal of geographical information science》2020,34(11):2243-2274

ABSTRACT

High performance computing is required for fast geoprocessing of geospatial big data. Using spatial domains to represent computational intensity (CIT) and domain decomposition for parallelism are prominent strategies when designing parallel geoprocessing applications. Traditional domain decomposition is limited in evaluating the computational intensity, which often results in load imbalance and poor parallel performance. From the data science perspective, machine learning from Artificial Intelligence (AI) shows promise for better CIT evaluation. This paper proposes a machine learning approach for predicting computational intensity, followed by an optimized domain decomposition, which divides the spatial domain into balanced subdivisions based on the predicted CIT to achieve better parallel performance. The approach provides a reference framework on how various machine learning methods including feature selection and model training can be used in predicting computational intensity and optimizing parallel geoprocessing against different cases. Some comparative experiments between the approach and traditional methods were performed using the two cases, DEM generation from point clouds and spatial intersection on vector data. The results not only demonstrate the advantage of the approach, but also provide hints on how traditional GIS computation can be improved by the AI machine learning.  相似文献   

基于EEMD和ARIMA的海温预测模型研究          下载免费PDF全文

张莹  谭艳春  彭发定  廖杏杰  余昱昕 《海洋学研究》2019,37(1):9-14

类型丰富、时空分辨率高的海洋探测数据,为信号分解和机器学习算法的应用提供了可能。本文针对如何建立有效的海温预测模型这一问题,使用高时空分辨率的海表温度(SST)融合产品,引入信号处理领域的集合经验模态分解(EEMD)和机器学习领域的自回归积分滑动平均模型(ARIMA)。首先利用最适于分解自然信号的EEMD方法,将海温数据分解成多个确定频率的序列;再利用ARIMA分别对各个频率的序列进行预测,最后将各个序列的预测结果进行组合。该方法在丰富数据的支撑下,比以往直接使用海温数据所建立的预测模型精度更高,为更好地进行海温预测提供了新方法。  相似文献   

基于深度卷积神经网络的剪切波分裂质量检测     

张彭达  戴志阳  查显杰 《中国地震》2020,36(3):539-549

剪切波分裂是分析地震各向异性的一种重要手段,常规方法是利用网格搜索获取分裂参数,再通过不同方法的测量结果对比测量结果进行质量检测,这一过程会耗费大量计算时间。本文针对这一问题提出了一种利用深度卷积神经网络对剪切波分裂进行质量检测的新方法,对使用了Resnet残差结构的深度神经网络进行训练,直接对二分量剪切波波形数据的质量进行分类。整个过程为:神经网络通过卷积层提取波形特征,计算损失函数后反向传播训练模型参数,完成迭代训练后的模型对输入波形数据正向计算自动输出类型。本文利用川西台站接收到的实际数据以及随机生成的合成数据分别对该网络进行训练,均可以获得准确的分类结果。相比于通过多种剪切波分裂方法对比测量结果的质量检测方法,基于神经网络的方法可以省略网格搜索的计算过程直接判断质量类型,在运算速度上的优势明显,并可继续通过训练提高模型的精度,为提升剪切波分裂方法在数据处理过程中的操作效率提供帮助。  相似文献   

一种基于M估计的Robust-ELM滑坡位移预测方法     

高彩云  高宁 《大地测量与地球动力学》2019,39(2):153-157

采用传统ELM算法进行滑坡位移预测时，其网络输出权值由最小二乘估计得出，导致ELM抗差能力较差，从而造成网络训练参数不准确。为此，将M估计与ELM相结合，提出一种基于M估计的Robust-ELM滑坡变形预测方法。该方法利用加权最小二乘方法来取代最小二乘法计算ELM输出权值，以减少滑坡监测数据中粗差对ELM预测的干扰。分别以链子崖、古树屋滑坡体为例，将Robust-ELM进行了单维、多维粗差的抵御性验证。结果表明，该方法能够有效降低粗差对预测的影响，具有良好的抗差能力。  相似文献   

基于深度残差网络的机载LiDAR点云分类     

赵传  郭海涛  卢俊  余东行  张保明 《测绘学报》2020,49(2):202-213

机载LiDAR点云的分类是利用其进行城市场景三维重建的关键步骤之一。为充分利用现有的图像领域性能较好的深度学习网络模型,提高点云分类精度,并降低训练时间和对训练样本数量的要求,本文提出一种基于深度残差网络的机载LiDAR点云分类方法。首先提取归一化高程、表面变化率、强度和归一化植被指数4种具有较高区分度的点云低层次特征;然后通过设置不同的邻域大小和视角,利用所提出的点云特征图生成策略,得到多尺度和多视角点云特征图;再将点云特征图输入到预训练的深度残差网络,提取多尺度和多视角深层次特征;最后构建并训练神经网络分类器,利用训练的模型对待分类点云进行预测,经后处理得到分类结果。利用ISPRS三维语义标记竞赛的公开标准数据集进行试验,结果表明,本文方法可有效区分建筑物、地面、车辆等8类地物,分类结果的总体精度为87.1%,可为城市场景三维重建提供可靠的信息。  相似文献   

基于随机森林的光子计数激光雷达点云滤波     

陈博伟  庞勇  李增元  卢昊  梁晓军 《地球信息科学学报》2019,21(6):898-906

新一代星载激光雷达卫星ICESat-2首次采用了微脉冲光子计数激光雷达技术,由于单光子探测的灵敏性导致数据在大气和地表下层产生了大量噪声,因此对光子计数激光雷达点云数据实现信号和噪声的分离是开展进一步应用研究的前提和基础。本文选择美国俄勒冈州和弗吉尼亚州2个研究区,采用MATLAS数据,根据光子点云数据的特点构造了12个光子点云特征,对所构造的特征利用随机森林进行变量筛选,用机器学习方法对光子点云进行分类,并将建立好的模型推广到整个研究区。研究结果表明,本文构建的分类器分类总精度达到了96.79%,Kappa系数为0.94,平均生产者精度和用户精度分别为97.1%和96.8%。在相对弱噪声、平坦地形区域和强噪声、复杂地形区域都取得较好的分类结果。本文结果显示了基于少量样本通过机器学习的方法构建模型,可以推广到较大范围区域的光子点云分类应用中。  相似文献   

基于超像元词包特征和主动学习的高分遥感影像变化检测     

杨进一  徐伟铭  王成军  翁谦 《地球信息科学学报》2019,21(10):1594-1607

为解决高分辨率遥感影像变化检测中存在底层特征缺乏语义信息、像元级的检测结果存在“椒盐”现象以及监督分类中样本标注自动化程度较低,本文提出一种基于超像元词包特征和主动学习的变化检测方法。首先采用熵率分割算法获取叠加影像的超像元对象;其次提取两期影像像元点对间的邻近相关影像特征（相关度、斜率和截距）和顾及邻域的纹理变化强度特征（均值、方差、同质性和相异性）,经线性组合作为像元点对的底层特征;然后基于像元点对底层特征利用BOW模型构建超像元词包特征,并采用一种改进标注策略的主动学习方法从无标记样本池中优选信息量较大的样本,且自动标注样本类别;最后训练分类器模型完成变化检测。通过选用2组不同地区的GF-2影像和Worldview-Ⅱ影像作为数据源进行实验,实验结果中2组数据集的F1分数分别为0.8714、0.8554,正确率分别为0.9148、0.9022,漏检率分别为0.1681、0.1868,误检率分别为0.0852、0.0978。结果表明,该法能有效识别变化区域、提高变化检测精度。此外,传统主动学习方法与改进标注策略的主动学习方法的学习曲线对比显示,改进的标注策略可在较低精度损失下,有效提高样本标注自动化程度。  相似文献   

青藏高原东北缘重力场深部结构及其动力学特征          下载免费PDF全文

王鑫  姜文亮  张景发  王德华  田云峰  申文豪 《地球物理学报》2020,63(3):988-1001

本文采用欧拉反褶积、场源参数成像(SPI)、场源边界提取(SED)、莫霍面反演、地壳三维可视化等多源方法,对青藏高原东北缘地区的布格重力场进行反演与分析,深入研究该地区的深部结构与变形特征,探讨区域深部孕震环境及动力学机制.研究表明,青藏高原东北缘的布格重力场整体呈负异常值,具有明显的分区性,表现出鄂尔多斯盆地异常值相对偏高、阿拉善块体次之、青藏高原块体极低的特点,其中海源断裂系形成了一条宽缓的弧形重力梯度条带,梯度值达1.2 mGal·km^-1.欧拉结果显示,鄂尔多斯盆地相比于青藏高原块体而言,场源点具有较强的均一性,场源强度值高(密度值高)且深度稳定在25~32 km范围内,而高原块体的中下地壳尺度广泛分布着低密度异常体.SPI图可知,海源弧形断裂系位于“浅源异常”弧形区,反映其地壳较为活跃,易发生中强地震.SED图揭示青藏高原地壳向东北扩展,经过几大断裂系的调节后运动矢量向东或东南转化,SED与GPS、SKS运动特征大致相同,说明地表-地壳-地幔的运动特征有着较强的一致性.青藏高原东北缘地区壳幔变形是连贯的,加之莫霍面由北向南、由东向西是逐渐加深的,因此属于垂向连贯变形机制,不符合下地壳管道流动力学模式.区域形成了似三联点构造格局,其中海源弧形断裂系的深部地壳结构复杂,高低密度异常体复杂交汇,是青藏高原、阿拉善、鄂尔多斯三大块体相互作用的重要枢纽,其运动学特征总体为中段走滑尾端逆冲,而断裂系正处于大型的弧形莫霍面斜坡带之上,具备强震的深部孕震环境,因此大尺度的运动调节与深部孕震条件共同促使了该地区中强震的多发.  相似文献   

Deep neural network application for 4D seismic inversion to changes in pressure and saturation: Optimizing the use of synthetic training datasets     

Gustavo Côrte  Jesper Dramsch  Hamed Amini  Colin MacBeth 《Geophysical Prospecting》2020,68(7):2164-2185

In this work, we tackle the challenge of quantitative estimation of reservoir dynamic property variations during a period of production, directly from four-dimensional seismic data in the amplitude domain. We employ a deep neural network to invert four-dimensional seismic amplitude maps to the simultaneous changes in pressure, water and gas saturations. The method is applied to a real field data case, where, as is common in such applications, the data measured at the wells are insufficient for properly training deep neural networks, thus, the network is trained on synthetic data. Training on synthetic data offers much freedom in designing a training dataset, therefore, it is important to understand the impact of the data distribution on the inversion results. To define the best way to construct a synthetic training dataset, we perform a study on four different approaches to populating the training set making remarks on data sizes, network generality and the impact of physics-based constraints. Using the results of a reservoir simulation model to populate our training datasets, we demonstrate the benefits of restricting training samples to fluid flow consistent combinations in the dynamic reservoir property domain. With this the network learns the physical correlations present in the training set, incorporating this information into the inference process, which allows it to make inferences on properties to which the seismic data are most uncertain. Additionally, we demonstrate the importance of applying regularization techniques such as adding noise to the synthetic data for training and show a possibility of estimating uncertainties in the inversion results by training multiple networks.  相似文献   

Redox evolution of western Tianshan subduction zone and its effect on deep carbon cycle     

《地学前缘(英文版)》2020,11(3):915-924

Knowing the phase relations of carbon-bearing phases at high-pressure(HP) and high-temperature(HT) condition is essential for understanding the deep carbon cycle in the subduction zones.In particular,the phase relation of carbon-bearing phases is also strongly influenced by redox condition of subduction zones,which is poorly explored.Here we summarized the phase relations of carbon-bearing phases(calcite,aragonite,dolomite,magnesite,graphite,hydrocarbon) in HP metamorphic rocks(marble,metapelite,eclogite) from the Western Tianshan subduction zone and high-pressure experiments.During prograde progress of subduction,carbonates in altered oceanic crust change from Ca-carbonate(calcite) to Ca,Mg-carbonate(dolomite),then finally to Mgcarbonate(magnesite) via Mg-Ca cation exchange reaction between silicate and carbonate,while calcite in sedimentary calcareous ooze on oceanic crust directly transfers to high-pressure aragonite in marble or amorphous CaCO3 in subduction zones.Redox evolution also plays a significant effect on the carbon speciation in the Western Tianshan subduction zone.The prograde oxygen fugacity of the Western Tianshan subduction zone was constrained by mineral assemblage of garnet-omphacite from FMQ-1.9 to FMQ-2.5 at its metamorphic peak(maximum P-T) conditions.In comparison with redox conditions of other subduction zones,Western Tianshan has the lowest oxygen fugacity.Graphite and light hydrocarbon inclusions were ubiqutously identified in Western Tianshan HP metamorphic rocks and speculated to be formed from reduction of Fe-carbonate at low redox condition,which is also confirmed by high-pressure experimental simulation.Based on petrological observation and high-pressure simulation,a polarized redox model of reducing slab but oxidizing mantle wedge in subduction zone is proposed,and its effect on deep carbon cycle in subduction zones is further discussed.  相似文献